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Abstract of JP1 1085457 

PROBLEM TO BE SOLVED. To enable an 
operator to quickly confirm the contents of an 
original image by voice without displaying an 
image of the whole original image. 
SOLUTION: A CPU 101 analyzes a read 
original image, extracts a rectangular area of 
an optional size, adds each different attribute 
data to the rectangular area based on the form 
of each extracted rectangular area, analyzes 
image data in a rectangular area, to which 
attribute data are added to recognize character 
information and stores the character 
information and the attribute information in an 
external storage device 104 together with the 
image data. Then, the CPU 101 specifies an 
original image to be retrieved and its attributes 
out of stored original images, judges whether 
or not an area based on the specified original 
image and attribute are selected from an 
external storage device 104 or not and 
controls the voice reading of character 
information added to area information which is 
executed by a voice synthesis part 109 
through a speaker 1 1 0 based on the judged 
result. 
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[0 0 4 9] 4*5, «8©K#ii*fi-l';*-S?**-lr-f 
(X*t7"l 0 8) JC[$S&cDTtt4<, ftgg£1g&fi 

i o 4iitcfe&fri;&gett£ftfc i t>©-c f fedT&<fci/\ 1 

WffiiliRAMl 0 3lcfEHf£J:-5fltlSLT 
fe<tf 0 *f=, ffifa^ia^Jn^TiaPittiitcSSflllOx- 
£ SPl'S ii'W „d b ' lili f f t „C M * n T U> S IA tt^wt^ji 30 

[0 0 5 0] Hte, ^^fiS^atov^Tfi^^gp 

i o 9ciK3 fe©T«4<, #tj&sn§yn 

*3A^CPU l 0 l*^f5T3Cfcfc<J:?)§i51t$B*fc 
fiSTS J: a (c «S<iTi^ T fcBgH&f . 
[0 0 5 1 ] 4/c, fSlSttiiS^a-^S14frta^!coi> 

ilb/c77?£-tcPfSfe©Tfi4 <, KttoSSfcof Tt, 
**«fiJBffiT 8ffl b fc fe © tc Pi 5 ft f c k fi s a * T fe 
4f. io 

[0052] ffi i-mmim ±mm 1 

1 i ; [,', .mh 1 u 1 it cn , ,ei ;^,v; i o 
4 k lati-r § rn^mrn l * # , x- * jbuisht* a m 
m^aztircmm, jstt. s^iihb*^.— w^iet 

THHWTS. 

[0 0 5 3] 4*5, *Hasff?iB(c fc nt5r-^Ma&g 
«0 1K*L;fc£ -©HMSrWbTf 50 



iff Pr3¥ 1 1 - 8 5 4 5 7 
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S„ 

[0 0 5 4 ] J^T, 0 5 *W& bT, t*-* Maggie 

sSiiEfcfc S 7 4 Ji f y ^ 7 x -XK-o 

f TRET*. 
[0 0 5 5 ] 05tt, 01 CSLfcfVX7'H' 1 0 5 
l:!.-i<-!<vT nSB 2 ©igffIS^7-Y > F7 o-mzwiw 

TSHTSiSc, 4*3, 02 klBJ-OfeOKaiaj-O^ 

SSSW44 Sil^-^TiR bT f So 
[0 0 5 6 ] Efcfev^T. \V2(«aMiT-7-0*F7 
T, A * * S O *i£ k Y ^ - -7' k ^jg 

SbfclF^P ltfSf^nw So la, lb, 2-8 
ttJl^SP 1 A^WlffiSti/iSMi^TS 1 ?, Sfi^l a, 1 
b, 2~8t4*ft* f ft#t8L la, Lib, L2-L8 
tctOHSti, ffflOfl^ k EgiJ ^T t S <t 5 1 S/7s S n 
T^S. 4*5, ffl&l a, SSHcl b(iMtbbt?SSSIC* 

r^-g-figs^icof j k rrj ko~o©gp»tc«- 

fflStlTWffiStlTV^Sif^KMJS-rSo 4*5, 0/^b 
Tf 4f A" 1 C ©7 -1" 7 F 7 W 2 ±Tfittl±l SnftffilSe 

bssbtss i?c^snw sfeokfSo 

[0 0 5 7 ] CcOJg(^^7-<'7F7W2±iC*5fT, 
W^.«'M^1 b^rStR-rstf^tt, WVT^^f^ 
-fX 1 0 7«l«ffifflbT^iSl brt^fl^bT^U 'V? 

fntfjt^sn, c©Npgwstifcffi«i bawl i 

b^rfl!!©fiqiij;0*<g^$tlSo 4*3, iSR^nTf 
S©*^ D^T < 4S^/^AU DH 1 cDii t5 * Tfe 
4fo 

[0 0 5 8 ] l?atfMMl aOXti^^MtS 

if^-SCli, *V 7-r -C y?"f>WX 1 0 7 TMii 1 a £0 
tw^ («*8L 1 a) ttftZm^U F7-y 7*#^tcit) 
fiiSSL 1 a *-Ofrk?mW.(Oimt.T°&WiLT 
tzctlc J;t)iifig2ns 0 gfc, Mtft5»l 
iJttttSTt 4*^o fcfci6tc , fffc4fB^%fffigb4^n 
«'4b4v^lf^{i:a, 7r-f y?f/WX 10 7^: 

s. 

[0 0 5 9 ] ffjAJf, gt^lfcW 1 a hflitt 1 b 

gijtiTWtu tnr b s o fe bas% 1 o <o«g«fc * k 

S-f, Mil: b%»ltl»ni\ 
^1 bt-gtnTffc TTJ mmi aOWL 1 a 
rtK-a-StlSJ;9lC4<-f 7t--i"77tvWX 1 0 7 
*> F9yy)tffUT««l a CQ|«§ L 1 a ©At*^^ 
Sg^-tirSC fcJcfcD, ^Sfti/hffiH? 1 a, t4to^fl 
^HeMteb^A^SnSidtcML 1 A<Mttib^ 
f*-&B3t?»; -5(cS57L C p1?<U>,7'IM 7 «,t 



(8 J 



-85457 



[0 0 6 0] @5{C7jsLfcj; aic, n— tf'o^^yf -i- 
i^^>F^/W2iT\ ftiSoJtita, iff, ^S^o<g 
[0061] 0 6%#s8lt, mwc^jnsnft 

Jltt^lAt^ii^fc-rVX^H- 1 0 5±K«3S«tl 

[0 0 6 2] H6tt, EI 1 KjSLfc-r-f XTW 1 0 5 
J:iC*L>.t; Jlie KftS il - -5 Y > F 7 ^-f^J =& rf 5 H 

[0 0 6 3] HfcfcloT, W3«JSffl£IE7-YyF7 

mnx^z wm a- « y x < > y t> * -c x 1 

0 7 f©?"7 - /^ U v tmt K J: <3 gflfrftS HpS?'<g 
t), 0K#^yE l i: + ^>-tr;l/*'^>B 2 fcffittfglE 
iK'^XBOX 1 t^sMsntv^. 

[ 0 0 6 4 ] gfc, immJE /Ky^XBOX 1 «JH4£ 

lj t«jE , r.5«^taiwrss@z2, r/j>iiaiLj 

i§£-fcjgj«-f S^iZ 5, ry^Xj fcflsiErsif^K: 

s«-f @ z 6frf,W3nT^5. 

[0 0 6 5] fcfc, IBttfiIE7^yF7W3_h'T i fi, * 
-/yf^yf^XI 0 7*!»ftLTJg1£fflSiEjF:«y* 
XBOX lrtCSBZ 1~Z 6%ii^LT, OKjK^> 
B 1 £?>J >v ZTZZtlck K>M&Z»IE?Z>Ct.tfT' 

[0 0 6 6] flUtf, 15KiUftW 1 a (DJStttf 
t&oTi«^i, Ml a*3«?U JBStt 
#;IE 7 -f > F 7 w 3 ±T-IE b iy JS'S^SlfR-f i> C t ic J; 
0 <§IE* 5 o /SfflilE 7 y K 7 W 3 fcJBtfcS 

[0067] co^stc, mmmo-^y k«7W3±t 
Wyf^y^wxi o 7^^ffl^Tj*fis-r«c:i: 

[0 0 6 8] WT. 07*#B8LT, <m*tl1t 

^mm^mm-r^m-^icy-ux-fu^ i o 5±tas 
£ft«7-< y F>>%ifflt5. 

[0 0 6 9] 07fis El 1 (C^bfcr-<XrW 1 0 5 
±fcSS2ft£;£?1i$S7'f' > H'i'O-FI^IM-rSH 

[0 0 7 0] Bfcfc^T, \ Fv 

KSSSftT ^SX^'lf ISfgEHi ^tf-Y Vr-f 

^x i o 7 w<o#7>\'5 y vtrnmcz d ham-is® 



Bfl-^SD, B 3 t£^tS$g{gIEtf-y7XB0 

X 2*64 **1«B»jEjKv f X B 0 X 2 rtic*^ 

[0 0 7 1] &fc\ CcDil-pttHSiC^L/c^Iigl CO* 

if - it i -cj _„',:„, ix Li ,r- 

[0 0 7 2 ] C «D J: 3 K^«y>^l&L-/£ 

Y K'JWUCftW, F 106Sft 

W^yf^^wx i 0 7^sfFLT, x?«$s 

«E#-y 7 X B 0 X 2 rt<0^tl$S^«t «5x S C t 

[0 0 7 3 ] Mill 05 fc^Lfc^^tSSlS 1 if r • 
• • 2s$c • • • J fcftoTU''5lfr&K N M^l^SfR 
20 U ttm&'O 4 y F'>W 4^r|giKLT, r^j * 

[0 0 7 4 ] X^'lf^^-fy F^W4±T 

^v-r-f y^fvwx i o 7^%ffli>T^-tSi:fc 
K J: 0 s i ttMcRtt* ft fcUWoi^m Mtf *BO A 

t t i &c BjExir&mt s c t t a „ 

[o o 7 5 ] wt, *^^6I^^^®© ! ^f^l4^*ll^!t^c•^v^Tl 

1. S5, E6, 0 7^#P,gbTH}fflf-5o 

[0076] ±gBo«t5t«iB2*tife, wiattffl^at 

^ftfcX^lfffi^g^W (fVxrwl 05) KUtk 

m&m mmwr^jyvvviz, mum^^yv^ 

W3, A^'ISlS , ?-Y>F'i7W4±T' ; r-^-F 10 6, 

■1 L^)£)FF'i « i /- ianu^iiK^^Ric y K J M J nftXt- 
T 5 Wili f w ( ISif-r 5 [21 8 {c *T 7 n 

« +-hKs-cJ*j[ia-rsc pu i o i) fc*^-rs<D 

« f n J - W t If U Hi r-* 

[0 0 7 7 ] WTv ««19ffi©Cg#tcBB-rsflfio^flHB 
[0 0 7 8 ] KSij, *?SWtC^Sir-^S!lf!I!SIS(C*5 
T-feSo ( 1 ) ~ ( 8 ) !i^Xf7 7^-To 

50 [0079] m i piM&mtmmcz**?- 1 o 



m®z±mmmmmh (2) , mmm^ntcmm^m 

(4) o fcfe, C©S#£T\ r-fXTWl 0 5fc«ltB. 
WlMiikT So 

[0080] Muisn^flmoaft«B5e^L 

fcKWSJtS** > F * W 2 ± X-m (5) . #fc % 4HK 

stoyimtmrnzm e tcs l tzmmssu > F>>W 3 

±Ttr? (6)0 
[0 0 8 1] 0 7fC^LrcX^1ff$g'i'-Oh*'i'W 

4±^X*t»ffiO«i^%R^ (7) > li^Xf"/? 

(5) ~ (7) tctefTH*. fiiEsn^M^, ait. 

1 0 4 i:(Sff!,T 

(8) , saa^T-rs. 

[0 0 8 2] «T« *SUfi}B!SOl$l»«fl!«Ko^rH 

[0083] ±ge©i;?fc#tj£Sft/i, Hijaattftifit 

± «J tlli i ft M . 1 I 1 - ' 1 r If ± 

g ffSSCXfy^ fc> mlB^XflfcJcSfiEiii 

mmxm ur^y (5) ~ (7) ) t^-fs©-^ 
tb £ ftfc*g ffM^t £ ©jsitf - * , ^*'»$gtc 

[0 0 8 4] W±f4fBLfc.fc5fc: > **$5®8gfc<fct>i!| 

M, flJBfc-r-scktf-ets. 

[0 0 8 5] *Hai®filT'tt[2l8©X-f-yy 

en ~ (3) x\ &z&v&mmmm:tti&Lr&ic 

lift, MEEft»*fioT^«tf, £T, *S^I4-tt© 
<, 0 8fflX-r'y:/ (5) ~ (7) (ommt, * 
[COS 6] 

i#;^«iELTA^ / 4,;r,2i:^ n 1 0 4K«iv-rsiB££ 
siwufc^ mmm&mi 0 Aizmmmsnx^z 

[cos] • .Tit-, i.ciotj-i-x-^ffiaSK 



(9) IfBiW 1 1 - 8 5 4 5 7 

16 

fi, 0 1 fc^LfcM l ^SIJBffitPI-^^^^LT^ 

So 

[0088] j h ,J< a ,bl !'...'£ 1 0 
4 KMfctBH snTV^JSSi^^fSS^Kr-c X7° 
w 1 0 5±fcS^;*ftS^§g^yF^klfflffifc*5 

§0 

[0 0 8 9 ] @9tt, H 1 £j*l/fcr-rX7W 1 0 5 

io -pfcSo HI6 t|p)-©feO{ctiil-©^^{tL 
T2b5„ 
[ 0 0 9 0 ] 

T\ F 1 0 6 SftttWyfr/ ^r/WX 1 

0 7 KJ; 0 ^'©||tT4t?S^?tX/=iI'&{cP,fl^tiS^ 

-r > k ^ t, mftmfettt b o x 3 insist £gi$ b 0 x 4 

£fr£>|§/££ftTl>l>. RISfJEWBOX 3**, Hf±lg 
/gOTZ 1 ~Z 6*^£ftT^$„ i.il^iii TU> ox 
4 (ft 1 0 4 ft^cpEtl^ftT^SMfl 1 

~5£7-YnyF 1~F 5*fflfTT^LTfet), K$5 
20 g^Stl*7'T3VF 2, F3, F5tfi^tlT 

[0 0 91] ±ffiOJ:-5fc«dc*tifc«iSH£'>'i'>'K 
fW5±Kfe^T, 4— *-F 1 0 6JftttWyf-f 

x i o 7 %j*ff LTs siiJi^gPB ox 3 n 
<oimmL iizi~z6 %sfi-r s c t ^ j; t> t^-r 

4fiCi7^3>F 1~F 5^jg^-rsci:K«j:t)^-r 

to. Sfc, BlttOK*^>T\ SSOK^'^yBl^ 

[0092] j>Kmm^Box4«, xnffimm 

©-gfi^j® «©«gijt ffi 9 «fc 9 KFflt $ ft T fc «fc 

[0093] co^^tc, «aaffie'>-i'>K'j'W5± 

[0 0 9 4 ] J-^Tv *^ffifl5M<0!SftW^JSCO^TIl 

1. H99*#HLTttWr*. 

[0 0 9 5] ±IB©J;3tc|,M$ftfc, X'^'W^^gJS 

tL-zmxruiM&si cs^aaui o 9, xe-* 

1 10) k, 9ul3^*UMjie«#$ftfcM^iifi©- 

*^-r«.c puioi) k, Buiea^ica^^ftsii 

50 T.iuffK^l^il^d-bfiiiC'. Silfifei^BIUH 



(10) 



t#ISl¥ 1 1 - 8 5 4 5 7 



17 

a*jB&r«»2o«)e#a (*-#-h*i oe, =jw 

511 0fc$t7B-ft- Rcg-^tW^-fSC PU 

ion fi9ffi«2©!fij^#aowsjssfcs-^^T 
#a (?T-)»^-^!'fiJ i o 9^iiiifpt5 c p u i on tit 

[0 0 9 6] tCF, Hi 0£#j$LT^4©-r-£S!i3I 

[0 0 9 7] H l Ott, *f^c&5T-*Jtt]ISBJ<: 

hT*&5o &&\ (D~(7)ttS7.f7^t. 
[0 0 9 8] £-r\ ^,^4- ffy^WS ©Wtfcifi/i! 
if B0X3±7^1-%/ift£^£L (l) , HfHffiJt 
g[5BOX4±T#^-t6M if [ j I _ , J ,,i J 

nftssa, ffli *i£7-r n v f 2 , f 3 , f 5 i^±xmm 
zftrcfrZifrzvmL (3) , ^xcommtmmsn 

[0 0 9 9] ±TOJSS6^5nTl/^*U^W 
Bf^n/c±I^tt, Xr-yX (4) IXPtNCjt&o &*5, X 

7- , i) ~ (6) «>n i %mmt <m- m;u\ 
fciKtt©s«;W^Ttu£*©£¥if«%xtf-# i i 

[o i oo] ^t, ^u-^^sosaa^^iff sji 
* £ n ^ if 3 *>\ t a t> % a g * t fc+ + y 
•fe;M**:/B zimztifcfr Zofr%fmL (7) , jf 
snri/^^twrrt/cii^tt, xr77" (3) jck 

8. 

[0101] ahj$WL7c£ ?fc, «S!ifl5fI(CcJ;^^ 
^■T'<tJStt J f>X»*3.— ♦f*'iBI^<fi^Rl^fcLfc 

d, r^'UMH^^if-rsc tt<tD, <xsw±©iifi 
m $©&it& tmm* *m± x t s assays s. 

[0 1 O 7-|> ■ >a iXli, WiMtkfttLXm 

[0 10 3] tteR*tiTt^B««feK»±lf* 

[0 1 U] r,, l 'a 1 7 ' ,H'i'fO^*0^^5 
i it' I 
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[0 10 5] J-7.T, *^»»fll<0l««ll««J«KO^TH 
l 0«*#!BbTKWr*. 

[0 10 6] ±K©J;?£*ifiSiSnfc, B5ie«#ISt 
J: •) ftfcKSffitt© -** <fc tf ft* k f « M 

(TFH^ox-f 77°) k, iuias^'g[5ts^srL§MS 
j&r*»2©iftfc-£B (i 1 ocxx-y^ ci) . 

10 (2)) mSSS2<omi£imic£ tiitM& 

£«£T£:n2©*fcX*V. ([711 0 6JX7-'y7° (5) ) 
t, u j ^ > J i_ E ) t i]^,' . , )i i > C 7 , h'ljf 

igr^tLTm^-rsaj^xs (0100x777" 

(6) ) k*^-rs«Dt?, ^gbfeli«*-K^T? 

m&<tm®mx'zz, 

[0107] ht- m 1 1 t^-r^^'j^ y?*&mL 

20 S0.a^ , n^7i»O«fiECOl^g«HB'rSo 

[0 1 0 8] 11 ni, *mm&2>7-'- tmmmx 

* 'J 7*l«B^-r 5El7?fe5 o 

[0109] &*3, mmmmzmw, 
sn«7n ^7i,fff*wa-rsit«, Wl^Jf^-yg v 

[01 10] 5bC, M/n^AKffiltsf-^ 

^A^, -T yx h-;l/-T5 7n^9AA !i Jlii*nTVMS 
tg-a-fc . MtST'n^Ait. Eli 5 n 5 t $> 

[0111] *^it)fJg|(Cteit«03, 14, 08, 0 
l 0 fcj^-rSfoEAWasfr 5 -< >X h-;l/$ n« 7n ^5 

fejc^o "E" tT, *©i§£\ CD-R0M*777-> 3 

•1" -:r r- ^ „dl- 'V 0 wi,M«7h7- 
40 ir*^LTj^»(0IE«(K*fr6, fu^KZttsm 

mz&?}mmKi%i<eiiEn%m£X'h*m}Jiimmzn% 

[0 1 12] «_h©d;5(c, i!u^b/;^Mifl7flS©«* 
V X h 7X7 d7n ^-9 A3- F ^ffiSS L/cffi 
tSSf«*, vXTAfc5l^±-it,7»c«^b, fC7Xr 
Afei.l/H4gBO=i>tf^.-^ (IftliCPUWP 
U) !B«Ei8«#fcl8iMStifero^-7A3-K*Kfflb 

so [0113] cons, EHMI«**^R*tfJSnft^o 



en; 



mm- 1 i 



8 5 4 5 7 
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0 , ^© 7°n V^hzi- F£lBi«Lfc8B1Sim±* 
fP^&ifffitrac ktc&s,, 

[0114] ro^i»3-F««a&r5fc«)©E«K 

ftkLTtt, 7D7 tf— r-cX^, A-h'fl' 

X*, ftrVX^, ftfi^Vr^Xi', CD-ROM, C 

d-r, m%7—y\ ^»«tt©^*y*-K, ro 

M, EEPRO M%"&ffi^« C k T*£3>. 
[0 l l 5] nyt?i-*tfM&tHL/::7 p py-7 

£gtf^K2n«7StT*ft<, ^©7°a?'5£.3- F©fg 

V— r-f >y->X-rA) ^*ISO^ffl©-a5SfcJ±^ 
SR^fTV^ ^ ©MWc J; -j T MM L fc^MJ <g©$£^# 

[0 l l 6] ££>ic, S31s$t£fr^*Hi£nfc7'n>7 

n y t° a SBB!« tl fellSH - F tfflto 

*K*3*> *0«<iae^^-F J ?«lflgffi3S3.--y FK 

«fcic p u wjgaamo-ftt fctt&0*fi<r\ 

[0 117] 

o^tc in (f, isfi±©£»Wfi£if*is *)H«r r - 

m 5 n/c Suf S ilff r - * *t L T ffi£jgCffi Wf * A 1 6 

«lttr-* *fiftrraf<Hin#Sk, iWEftm^StJ: 
m'f'i r . i I',, _ . 1 8 9,¥&t, &ffimzttL 

ximmnzmiz* t> muz ntcic-mm &zfm,m 

E«#+ 5 ft S k ^ t SOT, B**" ^SKMH 
D Hi L TS£§ 'If ffi k «{;: g € , !f fcfc 3 g 

[0 118] S2 0SfflU»cj:nfcr, X?1f«*S?fkb 
Ttt!?Watti7^Kk, iiu,Sy^US»ca31tSti/ciI 

«f-*iL« LTtt»-r«* mmmmm-fetzm 1 

oiSfSi: - BOIES l ©ffi£#8K«fc SigJ&Stifcfi 
ttKStJ < SUStfSuSB;* * U Hil^ &S«S tifo^k 5 
^Wtt5 S6 l WMSt, iffiiffiSB 1 ©«5E¥fi§© 

w sass* (c s -o ^ t flags tt* # mc i § «*±tf* 
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T\ Bfix-^^O-f >< -:^S^£-fra ft #>©£*: 

&&yiBSP.g k -r 5 c t & < . g§su tm\m&* 
epxwm j; < »sa#s c k*n?*So 
[oi i9] S3©«wKJ;nff> SuieJSffl¥Sic*!3 

k. S8E«*»fc: J: DS^*nf=j©g««Sfca3ic¥1S 
<fc SttiEJB^lcfitJv^TM SBlft Hl^SK =fc DtfitBSti/c 

m^-^u-^^m^r^mBfrn^ c kA^ts„ 
[oi 20] ^4©?gwt <tntf, s^'ii^^kL 
twt?% tB^j^tsk, lij^ty jgjgK «#$nf=M 

fB^/SSPtc sjss-^ss 2 nwtMm-m t s mmm 

20 mm38£xfm&mB%mjg.t%%i2(Dt§^mt, mm 

* U jg ®^ 6 51IIR $ n A^ k* 3 frfcf ij SI" 5 ^ 2 © 

wjE^at , stie^ 2 on *#«©«jsia»e»dv*T 

[0121] ^5, S6<DSS^O:tl(f, gm±C)}S:» 
30 EKS5I8CJ:t)K*«6ti iiu.J ^ ^'h 

■Piik, iMBWAPX^lc J; 0 Wttr-^*M**OStife*Hi 

PMi&Pw mmf- $ ZMffi vxicr-mm zmm? a i?« 
stink, &mmictti<x mmwmxmic <t d isitsn 
fex^w *b j; rsmmfi 9 m u x mmmwf 
-*ktt,\£**v xkc ffiff-t- a«#x s k * *rr a 
©T\ ^•r'<t®«iii»*^6^**-kLr*ai 
io vsmij&fflmmv) <o m \.xm^m tm^mm 

ftX t , 3. -if K J; « S» H»©«@f5lB* © A^SIta* 
[0 1 2 2] 35 7, A ff5 8©?gHJ!t J:tx«', ffimUft-XU 

iz£QmfZfttcm®7 ! -2iz-%Lxtim?-*.%mw<D 
m&it&fe-tzm i ©igsiiik, mmm 1 ©jg^xg 

mm i mmxmvm&mm^M'j^xx^mmziips 
50 fcLTtB^-rattj^xgk^ff-ra©-! 5 , 



<$mz&zc tWT*ZZ, 
[0123] m&, mi oommts mmmrnxmicx 
t> m ta ts ntc mmmts a v MasaieE * *> mm * 

Ill r 1 / I ^ " 1 1 ' I- Ml'' * ' J . In I 

tfifg^tcstJ^Tfjiawffi lit j: *> am stifcjeg 
«B« s fc a tu latfiiiii fc £. <o mm -$nrc± ^mmm 

JEJB8I«. /Sfix-^, X¥fl!«<o«iE. HUBS?* 
Set**?**. 

[0124] 1 1, 31 1 2 OpgBjm, MES^Igfc 

j 1 i n 1 " m' it jro-mmnmtt^m 
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(54) [Title of the Invention] DATA PROCESSING 
APPARATUS, DATA PROCESSING METHOD FOR DATA PROCESSING 
APPARATUS, AND STORAGE MEDIUM STORING COMPUTER- READABLE 
PROGRAM 

(57) [Abstract] 

[Problems to be Solved] 

To allow an operator to confirm the contents of an 
original image in voice in a short time without 
displaying the entire image of the original image. 

[Solution] 

A CPU 101 analyzes a read original image and 
extracts the image in a rectangular area of an optional 
size, adds different attribute data based on the form 
of each of the extracted rectangular areas, analyzes 
the image data in the rectangular area to which the 
attribute data is added and recognizes character 
information, adds the character information and the 
attribute data and stores the result with the image 
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data in an external storage device 104, specifies the 
original image and attribute to be retrieved for the 
stored original image, determines whether or not an 
area based on the specified original image and 
attribute has been selected from the external storage 
device 104, and based on the determination result, a 
speech synthesis unit 109 controls voice-reading 
through a speaker 110 of the character information 
added to the area information. 
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[Claims for the Patent] 

[Claim 1] 

A data processing apparatus, comprising: 

read means for reading a document image on an 
original and outputting image data; 

extraction means for analyzing the image data read 
by said read means, and extracting a rectangular area 
of an optional size from the original image ; 

addition means for adding attribute data different 
based on a form of each rectangular area extracted by 
said extraction means; 

recognition means for analyzing image data in each 
rectangular area to which attribute data is added by 
said addition means, and recognizing character 
information; and 

storage means for adding the character information 
recognized by said recognition means and the attribute 
data to each area, and storing resultant data with the 
image data in memory resources . 
[Claim 2] 

The data processing apparatus according to claim 1, 
further comprising: 

output means for voice-outputting character 
information; 

first specification means for specifying an 
attribute of an area to be retrieved for image data 
stored in the memory resources; 

- 3 - 
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first determination means for determining whether 
or not an area based on the attribute specified by said 
first specification means is selected from the memory 
resources ; and 

first control means for controlling voice-reading 
by said output means based on a determination result by 
said first determination means. 
[Claim 3] 

The data processing apparatus according to claim 1, 
further comprising: 

first display control means for displaying the 
rectangular area extracted by said extraction means and 
the character information recognized by said 
recognition means on a display unit; 

instruction means for issuing a correct 
instruction for the rectangular area or the character 
information displayed on the display unit; and 

edition means for correcting the rectangular area 
extracted by said extraction means or the character 
information recognized by said recognition means in 
response to the correct instruction from said 
instruction means. 
[Claim 4] 

The data processing apparatus according to claim 3, 
further comprising; 

output means for voice-outputting character 
information; 

- 4 - 
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second display control means for displaying on the 
display unit a list of original images stored in the 
memory resources and a list of attribute items to be 
retrieved; 

second specification means for specifying a 
desired original image and attribute item from the 
original images and attribute items displayed on the 
display unit; 

second determination means for determining whether 
or not an area based on the attribute specified by said 
second specification means is selected from the memory 
resources; and 

second control means of controlling voice-reading 
by said output means based on a determination result by 
said second determination means. 
[Claim 5] 

A data processing method for a data processing 
apparatus, comprising: 

a reading step of reading a document image on an 
original and outputting image data; 

an extracting step of analyzing the image data 
read in said reading step, and extracting a rectangular 
area of an optional size from the original image; 

an adding step of adding attribute data different 
based on a form of each rectangular area extracted in 
said extracting step; 
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a recognizing step of analyzing image data in each 
rectangular area to which attribute data is added in 
said adding step, and recognizing character 
information; and 

a storing step of adding the character information 
recognized in said recognizing step and the attribute 
data to each area, and storing resultant data with the 
image data in memory resources . 
[Claim 6] 

A storage medium storing a computer- readable 
program, comprising: 

a reading step of reading a document image on an 
original and outputting image data; 

an extracting step of analyzing the image data 
read in said reading step, and extracting a rectangular 
area of an optional size from the original image; 

an adding step of adding attribute data different 
based on a form of each rectangular area extracted in 
said extracting step; 

a recognizing step of analyzing image data in each 
rectangular area to which attribute data is added in 
said adding step, and recognizing character 
information; and 

a storing step of adding the character information 
recognized in said recognizing step and the attribute 
data to each area, and storing resultant data with the 
image data in memory resources . 

- 6 - 
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[Claim 7] 

The data processing method for a data processing 
apparatus according to claim 5, comprising: 

a first specifying step of specifying an attribute 
of an area to be retrieved for the image data stored in 
said storing step; 

a first determining step of determining whether or 
not an area based on the attribute specified in said 
first specifying step is selected from the memory 
resources; and 

an outputting step of voice-outputting character 
information based on the determination result in said 
first determining step. 
[Claim 8] 

The storage medium storing a computer-readable 
program according to claim 6, comprising: 

a first specifying step of specifying an attribute 
of an area to be retrieved for the image data stored in 
said storing step; 

a first determining step of determining whether or 
not an area based on the attribute specified in said 
first specifying step is selected from the memory 
resources; and 

an outputting step of voice-outputting character 
information based on the determination result in said 
first determining step. 
[Claim 9] 

- 7 - 
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The data processing method for a data processing 
apparatus according to claim 5, further comprising: 

a first display step of displaying the rectangular 
area extracted in said extracting step and the 
character information recognized in said recognizing 
step on a display unit; 

an instructing step of issuing a correct 
instruction for the rectangular area or the character 
information displayed on the display unit; and 

an editing step of correcting the rectangular area 
extracted in said extracting step or the character 
information recognized in said recognizing step in 
response to the correct instruction in said instructing 
step . 
[Claim 10] 

The storage medium storing a computer-readable 
program according to claim 6, further comprising: 

a first display step of displaying the rectangular 
area extracted in said extracting step and the 
character information recognized in said recognizing 
step on a display unit; 

an instructing step of issuing a correct 
instruction for the rectangular area or the character 
information displayed on the display unit; and 

an editing step of correcting the rectangular area 
extracted in said extracting means or the character 
information recognized in said recognizing step in 
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response to the correct instruction in said instructing 
step . 
[Claim 11] 

The data processing method for a data processing 
apparatus according to claim 9, further comprising; 

a second display step of displaying on the display 
unit a list of original images stored in said storing 
step and a list of attribute items to be retrieved; 

a second specifying step of specifying a desired 
original image and attribute item from the original 
images and attribute items displayed on the display 
uni t ; 

a second determining step of determining whether 
or not an area based on the attribute specified in said 
second specifying step is selected from the memory 
resources; and 

an output step of voice-outputting character 
information based on a determination result in said 
second determining step. 
[Claim 12] 

The storage medium storing a computer-readable 
program according to claim 10, further comprising; 

a second display step of displaying on the display 
unit a list of original images stored in said storing 
step and a list of attribute items to be retrieved; 

a second specifying step of specifying a desired 
original image and attribute item from the original 

- 9 - 
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images and attribute items displayed on the display 
unit ; 

a second determining step of determining whether 
or not an area based on the attribute specified in said 
second specifying step is selected from the memory 
resources; and 

an output step of voice -output ting character 
information based on a determination result in said 
second determining step. 
[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates to a data processing 
apparatus capable of adding, a specific attribute for 
each area extracted after reading an original image, 
storing areas and voice-outputting character 
information in the stored area, a data processing 
method for the data processing apparatus, and a storage 
medium storing a computer-readable program. 

[0002] 

[Conventional Art] 

In the conventional data processing apparatus 
having an electronic filing function, when an original 
image input from a scanner etc. is stored in a storage 
device, a user-specified keyword etc. is associated 
with an entire original and stored in the storage 
device. When the stored original image is retrieved, 
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the keyword is input, the original associated with the 
stored keyword is retrieved from the storage device, 
any corresponding original image is read, and the 
original image is displayed on a display, etc. 
[0003] 

In the data processing apparatus for filing 
document information generated by an application, a 
retrieving process is performed using a keyword added 
in advance corresponding to each document, or using an 
entire document. 
[0004] 

[Problem to be Solved by the Invention] 

Since the conventional data processing apparatus 
is configured as described above, when the contents of 
the original image stored in the storage device are 
referenced, and especially when the contents are 
roughly grasped, there is the problem that, although an 
original can be grasped if a part of the contents of 
the original image are acquired, the process of 
regenerating the entire contents of the original is 
performed, thereby requiring a long time to confirm the 
contents . 

[0005] 

The present invention has been developed to solve 
the above-mentioned problem, and an objective of the 
present invention is to analyze a read original image, 
extract a result in a rectangular area of an optional 
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size, add. different attribute data based on the form of 
each of the extracted rectangular areas, recognize 
character information by analyzing the image data in 
the rectangular area to which the attribute data is 
added, add the character information and attribute data 
and store them with the image data in memory resources, 
specify original image and attribute to be retrieved 
for the stored original image, and control voice- 
reading the character information added to the area 
information based on the result of determining whether 
or not the area depending on the specified original 
image and attribute has been selected from the memory 
resources, thereby voice-reading the character 
information added to the area of the original image, 
and allowing an operator to voice-confirm the contents 
of the original image in a short time only by a simple 
operation of specifying an operator-specific attribute 
and an original image without the necessity to take a 
long time to display the image of the entire original 
image . 
[0006] 

[Means for Solving the Problem] 

The first invention according to the present 
invention includes: read means for reading a document 
image on an original and outputting image data; 
extraction means for analyzing the image data read by 
the read means, and extracting a rectangular area of an 
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optional size from the original image; addition means 
for adding attribute data different based on a form of 
each rectangular area extracted by the extraction 
means; recognition means for analyzing image data in 
each rectangular area to which attribute data is added 
by the addition means, and recognizing character 
information; and storage means for adding the character 
information recognized by the recognition means and the 
attribute data to each area, and storing resultant data 
with the image data in memory resources. 
[0007] 

The second invention includes: output means for 
voice-outputting character information; first 
specification means for specifying an attribute of an 
area to be retrieved for image data stored in the 
memory resources; first determination means for 
determining whether or not an area based on the 
attribute specified by the first specification means is 
selected from the memory resources; and first control 
means for controlling voice-reading by the output means 
based on a determination result by the first 
determination means. 
[0008] 

The third invention includes: first display 
control means for displaying the rectangular area 
extracted by the extraction means and the character 
information recognized by the recognition means on a 
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display unit; instruction means for issuing a correct 
instruction for the rectangular area or the character 
information displayed on the display unit; and edition 
means for correcting the rectangular area extracted by 
the extraction means or the character information 
recognized by the recognition means in response to the 
correct instruction from the instruction means. 
[0009] 

The fourth invention includes: output means for 
voice-outputting character information; second display 
control means for displaying on the display unit a list 
of original images stored in the memory resources and a 
list of attribute items to be retrieved; second 
specification means for specifying a desired original 
image and attribute item from the original images and 
attribute items displayed on the display unit; second 
determination means for determining whether or not an 
area based on the attribute specified by the second 
specification means is selected from the memory 
resources; and second control means of controlling 
voice -reading by the output means based on a 
determination result by the second determination means. 
[0010] 

The fifth invention includes: a reading step of 
reading a document image on an original and outputting 
image data; an extracting step of analyzing the image 
data read in the reading step, and extracting a 
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rectangular area of an optional size from the original 
image; an adding step of adding attribute data 
different based on a form of each rectangular area 
extracted in the extracting step; a recognizing step of 
analyzing image data in each rectangular area to which 
attribute data is added in the adding step, and 
recognizing character information; and a storing step 
of adding the character information recognized in the 
recognizing step and the attribute data to each area, 
and storing resultant data with the image data in 
memory resources . 
[0011] 

The sixth invention is a storage medium storing a 
computer-readable program including: a reading step of 
reading a document image on an original and outputting 
image data; an extracting step of analyzing the image 
data read in the reading step, and extracting a 
rectangular area of an optional size from the original 
image; an adding step of adding attribute data 
different based on a form of each rectangular area 
extracted in the extracting step; a recognizing step of 
analyzing image data in each rectangular area to which 
attribute data is added in the adding step, and 
recognizing character information; and a storing step 
of adding the character information recognized in the 
recognizing step and the attribute data to each area, 



- 15 - 



Whole Englsih translation of JPA11- 085457 

and storing resultant data with the image data in 
memory resources . 
[0012] 

The seventh invention includes: a first specifying 
step of specifying an attribute of an area to be 
retrieved for the image data stored in the storing 
step; a first determining step of determining whether 
or not an area based on the attribute specified in the 
first specifying step is selected from the memory 
resources; and an outputting step of voice-outputting 
character information based on the determination result 
in the first determining step. 
[0013] 

The eighth invention is a storage medium storing a 
computer- readable program including: a first specifying 
step of specifying an attribute of an area to be 
retrieved for the image data stored in the storing 
step; a first determining step of determining whether 
or not an area based on the attribute specified in the 
first specifying step is selected from the memory 
resources; and an outputting step of voice-outputting 
character information based on the determination result 
in the first determining step. 
[0014] 

The ninth invention includes: a first display step 
of displaying the rectangular area extracted in the 
extracting step and the character information 
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recognized in the recognizing step on a display unit; 
an instructing step of issuing a correct instruction 
for the rectangular area or the character information 
displayed on the display unit; and an editing step of 
correcting the rectangular area extracted in the 
extracting step or the character information recognized 
in the recognizing step in response to the correct 
instruction in the instructing step. 
[0015] 

The tenth invention is a storage medium storing a 
computer -readable program including: a first display 
step of displaying the rectangular area extracted in 
the extracting step and the character information 
recognized in the recognizing step on a display unit; 
an instructing step of issuing a correct instruction 
for the rectangular area or the character information 
displayed on the display unit; and an editing step of 
correcting the rectangular area extracted in the 
extracting means or the character information 
recognized in the recognizing step in response to the 
correct instruction in the instructing step. 
[0016] 

The eleventh invention includes: a second display 
step of displaying on the display unit a list of 
original images stored in the storing step and a list 
of attribute items to be retrieved; a second specifying 
step of specifying a desired original image and 
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attribute item from the original images and attribute 
items displayed on the display unit; a second 
determining step of determining whether or not an area 
based on the attribute specified in the second 
specifying step is selected from the memory resources ,- 
and an output step of voice-outputting character 
information based on a determination result in the 
second determining step. 
[0017] 

The twelfth invention is a storage medium storing 
a computer- readable program including: a second display 
step of displaying on the display unit a list of 
original images stored in the storing step and a list 
of attribute items to be retrieved; a second specifying 
step of specifying a desired original image and 
attribute item from the original images and attribute 
items displayed on the display unit; a second 
determining step of determining whether or not an area 
based on the attribute specified in the second 
specifying step is selected from the memory resources; 
and an output step of voice-outputting character 
information based on a determination result in the 
second determining step. 
[0018] 

[Embodiments of the Invention] 
[First Embodiment] 
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Figure 1 is a block diagram for explanation of the 
configuration of the data processing apparatus 
according to the first exemplary embodiment of the 
present invention. 
[0019] 

In Figure 1, a CPU 101 performs control of the 
entire data processing apparatus according to the 
program stored in ROM 102. The ROM 102 stores a 
program based on the flowchart shown in Figures 3, 4, 8, 
and 10 described later and executed by the CPU 101, a 
control program of the present apparatus, a program for 
processing (including a character recognizing process, 
an area extracting process, etc.) an image containing 
graphics, images, characters, tables, etc. 
[0020] 

RAM 103 functions as main memory, a work area, etc. 
of the CPU 101, and stores a document, an image, etc. 
An external storage device 104 is configured by storage 
media such as a magnetic disk (a hard disk, a floppy 
disk, an MO disk) . A display 105 displays the process 
contents etc. of a data processing apparatus. A 
keyboard 106 and a pointing device 107 are operated to 
input data and issue an icon instruction to a data 
processing apparatus. 
[0021] 

An image scanner 108 (or a scanner simply) 
optically reads an image of an original etc., and 
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outputs image data to the RAM 103 or the external 
storage device 104. A speech synthesis unit 109 
receives a character code and outputs voice information 
to a speaker 110. The speaker 110 voice-outputs the 
voice information acquired from the speech synthesis 
unit 109, etc. 
[0022] 

With the configuration of the data processing 
apparatus, the CPU 101 can analyze an original read as 
an image by the image scanner 108 etc. based on the 
character recognition program stored in the ROM 102, 
and recognize a sentence described in the original as a 
character code. 
[0023] 

Described below with reference to Figure 2 is the 
process performed by the CPU 101 of reading an original 
through the image scanner 108, and extracting an area 
from the read original and the display status of the 
original displayed on the display 105 when the area is 
extracted. 
[0024] 

Figure 2 shows the first original display window 
displayed on the display 105 shown in Figure 1. 
[0025] 

In Figure 2, an original display window Wl 
displays an original PI including mixed various 
sentences and images in different size of characters. 
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Areas 1 to 8 are extracted from the original PI . Each 
of the areas 1 to 8 is enclosed by frame lines LI to L8, 
and displayed such that each area can be distinguished 
from other areas. 
[0026] 

Described below is an example of the extracting 
process in each of the areas 1 to 8 in the original PI 
shown in Figure 2 . 
[0027] 

First, the original PI as an input image is 
divided into M x N small areas. If there is an image 
in at least one pixel in the divided small area, then 
it is determined that there is an image in the small 
area, and a thinned image is generated. 
[0028] 

Next, portions in which thinned images are 
connected are grouped to generate a small rectangle. 
There is a strong possibility that a rectangle having a 
large aspect ratio and shorter sides close to each 
other is a character line. Therefore, these rectangles 
are combined. There is also a strong possibility that 
a set of rectangles having almost equal shorter side 
lengths and arranged substantially at equal intervals 
refer to a text portion. Therefore, the set of 
rectangles is combined as one area. As a result, the 
areas 1 to 8 are extracted. 
[0029] 
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Described next is the process of adding an 
attribute to an extracted area. It is determined that 
the area 2 is probably a text portion from the area 
extracting step (generating by merging a plurality of 
small rectangles) , and an attribute of "text" is added. 
Similarly, the attribute of "text" is added to the 
areas 4 and 6 . 
[0030] 

Next, for the remaining areas, it is determined 
whether or not a character is included. Since an area 
including a character periodically shows a small 
rectangle indicating the presence/absence of an image, 
an area including a character can be selected using the 
characteristic. As a result, the areas 1, 5, and 7 are 
selected as areas including characters. 
[0031] 

If the area further satisfies the determination 
condition that it is larger in line width than the 
character line of a text portion, and are arranged in a 
position different from the column of the text portion, 
then an attribute of a "header" is automatically added. 
If it satisfies the determination condition that it is 
larger in line width than the character line of the 
text portion, and is substantially equal in width of 
the area to the column of the text portion, then an 
attribute of a "sub-header" is automatically added. If 
it satisfies the determination condition that it is 
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larger in line width, than the character line of the 
text portion, and is positioned at the lower end 
position or the upper end position of the original, 
then an attribute of a "page" is automatically added. 
[0032] 

As a result, the attribute of "header" is 
automatically added to the area 1, the attribute of 
"sub-header" is automatically added to the area 5, and 
the attribute of "page" is automatically added to the 
area 7. With the remaining areas, if the area is 
smaller, it is determined as "noise". Otherwise, it is 
recognized as a picture or a photo, and determined as 
"image". Since the area 3 is sufficiently large, the 
attribute of "image" is added, and the attribute of 
"noise" is added to the area 8. 
[0033] 

Thus, by automatically adding the above-mentioned 
attribute to an extracted area, it can be easily 
determined which attribute each area has for the 
original . 
[0034] 

The characteristic configuration of the present 
embodiment is described below with reference to Figure 
1, etc. 

[0035] 

With the above-mentioned configuration including: 
read means (image scanner 108) for reading a document 
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image on an original and outputting image data; 
extraction means (CPU 101 for performing an area 
extracting process) for analyzing the image data read 
by the read means, and extracting a rectangular area of 
an optional size from the original image; addition 
means (CPU 101) for adding attribute data different 
based on a form of each rectangular area extracted by 
the extraction means; recognition means (CPU 101 for 
performing a character recognizing process) for 
analyzing image data in each rectangular area to which 
attribute data is added by the addition means, and 
recognizing character information; and storage means 
(CPU 101 for controlling the RAM 103 and the external 
storage device 104) for adding the character 
information recognized by the recognition means and the 
attribute data to each area, and storing resultant data 
with the image data in memory resources (RAM 103 and 
external storage device 104) , a character information 
area that can be retrieved can be segmented using voice 
as a key from the original image to be registered and 
automatically stored with the registered information, 
the process of user inputting retrieval information 
about the registered image can be reduced, and an 
effective registered information appropriate for 
associating the registered image can be simply input. 
[0036] 
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Furthermore, with the configuration including: 
output means (speech synthesis unit 109 and speaker 
110) for voice -output ting character information; first 
specification means (keyboard 106 and pointing device 
107) for specifying an attribute of an area to be 
retrieved for image data stored in the memory 
resources; first determination means (CPU 101 for 
performing the process based on the flowchart shown in 
Figure 4 described later) for determining whether or 
not an area based on the attribute specified by the 
first specification means is selected from the memory 
resources; and first control means (CPU 101 for 
controlling the speech synthesis unit 109) for 
controlling voice-reading by the output means based on 
a determination result by the first determination means, 
the contents of the registered image can be efficiently 
checked by voice in a simple operation of an operator 
specifying an area to which an attribute is added 
without the necessity to take a long processing time to 
display an image of the entire image data. 
[0037] 

Figure 3 is a flowchart showing an example of the 
first data processing procedure for the data processing 
apparatus according to the present invention, and 
corresponds to the procedure of reading an original 
from the image scanner 108 shown in Figure 1, and 
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storing the original in the external storage device 104. 

(1) to (5) indicate the respective steps. 

[0038] 

First, an image of the original PI is input by an 
optoelectronic conversion by the image scanner 108 etc. 
(1) , the area of the input image data is extracted in 
the area extracting procedure (2) , and an attribute 
(text, header, sub-header, page, etc.) is added for 
each of the divided areas 1 to 8 . 
[0039] 

Next, a well known character recognizing process 
is performed on an area having an attribute including a 
character, the character information acquired from the 
recognition result is added to the area (4) , and the 
information about the position, size, etc. of the 
obtained area, the attribute of the area, and the 
character information, if any, are stored in the 
external storage device 104 etc. (5), thereby 
terminating the process. 
[0040] 

By repeating the process, a plurality of originals 
read from the image scanner 108 are stored as a 
combination of area information in the external storage 
device 104. Afterwards, an important portion of the 
image information stored using as a retrieval key an 
attribute specified and input can be retrieved. 
[0041] 
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Figure 4 is a flowchart showing an example of the 
second data processing for the data processing 
apparatus according to the present invention, and 
corresponds to the procedure of retrieving the original 
information stored in the external storage device 104 
shown in Figure 1. (1) to (3) indicates the respective 
steps . 
[0042] 

First, using the keyboard 10 6 and the pointing 
device 107, the attribute based on which retrieval is 
to be performed is specified, the area having the same 
attribute as the specified attribute is retrieved from 
the original information stored in the external storage 
device 104, the corresponding area is selected (1), it 
is determined whether or not there is the selected area 

(2) , and the process terminates if it is determined 
that there is no corresponding area. 

[0043] 

If it is determined in step (2) that there is a 
corresponding area, the character code of the character 
information about the selected area is transmitted from 
the external storage device 104 to the speech synthesis 
unit 109 and a speech synthesizing operation is 
performed, and voice-output is performed through the 
speaker 110 (3), thereby terminating the process. 
[0044] 
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Thus, for example, if the attribute of "header" is 
specified in step (1) , and the original PI shown in 
Figure 2 is detected, then the area 1 is selected. As 
a result, the "Relating to Speech Synthesizing 
Technology" as the character information added to the 
area 1 shown in Figure 2 is voice-read through the 
speaker 110. 
[0045] 

The characteristic configuration of the present 
embodiment is described below with reference to Figure 
4. 

[0046] 

With the above-mentioned configuration including: 
a reading step (step (1) shown in Figure 3) for reading 
a document image on an original and outputting image 
data; an extracting step (step (2) shown in Figure 3) 
of analyzing the image data read in the reading step, 
and extracting a rectangular area of an optional size 
from the original image; an adding step (step (3) shown 
in Figure 3) of adding attribute data different based 
on a form of each rectangular area extracted in the 
extracting step; a recognizing step (step (4) shown in 
Figure 3) of analyzing image data in each rectangular 
area to which attribute data is added in the adding 
step, and recognizing character information; and a 
storing step (steps (4) and (5) shown in Figure 3) of 
adding the character information recognized in the 
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recognizing step and the attribute data to each area, 
and storing resultant data with the image data in 
memory resources, a character information area that can 
be retrieved is segmented using voice as a key from an 
original image to be registered and automatically 
stored with the registered information, a user input 
process of the retrieval information about the 
registered image can be reduced, thereby simply 
inputting an effective retrieval information 
appropriate for associating the registered image. 
[0047] 

In addition, with the configuration including: a 
first specifying step (not shown in the attached 
drawings) of specifying an attribute of an area to be 
retrieved for the image data stored in the storing 
step; a first determining step (step (2) shown in 
Figure 4) of determining whether or not an area based 
on the attribute specified in the first specifying step 
is selected from the memory resources; and an 
outputting step (step (3) shown in Figure 4) of voice- 
outputting character information based on the 
determination result in the first determining step, the 
contents of the registered image can be efficiently 
checked by voice in a simple operation of an operator 
specifying an area to which an attribute is added 
without the necessity to take a long processing time to 
display an image of the entire image data. 
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[0048] 

As described above, according to the present 
embodiment, a simple operation of an operator 
appropriately specifying a desired specific attribute 
after adding the attribute and storing the original 
allows the original information in the area stored with 
the attribute to be read, and the contents of the 
original can be simply checked without regenerating the 
contents of the original as an image on the display 105. 
[0049] 

Reading an image is not limited to the process 
performed using the image scanner (scanner 108) , but 
the image can be stored in advance in the external 
storage device 104, etc. The area information can also 
be stored in the RAM 103. Additionally, an original 
stored in another data processing apparatus, a storage 
device, etc. in a remote position can be read using 
communication means. 
[0050] 

Furthermore, speech synthesis means is not limited 
to the speech synthesis unit 109, but voice information 
can be generated by the CPU 101 reading a supplied 
program. 
[0051] 

The area extracting method and the attribute 
adding method are not limited to the method according 
to the present embodiment so far as a similar effect 
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can be obtained, and it is obvious that the type of 
attribute is not limited to what is described with 
reference to the present embodiment. 
[0052] 

[Second Embodiment] 

In the above-mentioned first embodiment, the data 
processing apparatus analyzes an original image, 
extracts each area, automatically adds an appropriate 
attribute, adds character information character- 
recognized to an area including a character, and stores 
the data in the external storage device 104, but an 
area, an attribute, and character information 
automatically obtained by the data processing apparatus 
can be corrected by a user. An embodiment is described 
below. 

[0053] 

The data processing apparatus according to the 
present embodiment has the same configuration as in the 
first embodiment shown in Figure 1. 
[0054] 

A second original display window displayed on the 
display 105 when a user corrects an area extracted by 
the data processing apparatus and a graphical user 
interface on the screen are described below with 
reference to Figure 5. 
[0055] 
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Figure 5 is an explanatory view of an example of 
the second original display window displayed on the 
display 105 shown in Figure 1. The same components as 
those shown in Figure 2 are assigned the same reference 
numerals . The original displayed in the original 
display window is the same as that shown in Figure 2, 
but the extraction result is different. 
[0056] 

In Figure 5, W2 is an original display window, and 
the original PI including various types of sentences in 
different character and image sizes is shown, la, lb, 
2 to 8 are areas extracted from the original PI. Each 
of the areas la, lb, 2 to 8 are enclosed by the frame 
lines Lla, Lib, LI to L8 respectively, and displayed 
such that they can be discriminated from other areas. 
The areas la and lb correspond to the case in which the 
sentence of the header is divided and extracted into 
two portions of "Relating to Speech Synthesizing" and 
"Technology". Although not shown in Figure 5, it is 
assumed that the attribute and the character 
information corresponding to the extracted area are 
displayed in the window W2 , and the information can be 
checked. 
[0057] 

In this original display window W2 , for example, 
when the area lb is selected, the area lb is pointed 
and clicked using the pointing device 107, etc. The 
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selected area lb is displayed in the frame line Lib 
displayed thicker than other areas. It is preferable 
that the selected area is easily recognized. 
[0058] 

When the size of the area la is changed, the 
boundary (frame line Lla) of the area la is pointed by 
the pointing device 107, the frame line Lla is held by 
the dragging operation and dragged to a desired 
position. When a new area is to be generated because a 
necessary area cannot be automatically extracted, the 
new area can be generated using the pointing device 107. 
[0059] 

For example, when the header portion extracted as 
divided areas la and lb as shown in Figure 5, is 
combined as one area, the area lb is first selected and 
deleted, and the "Technology" included in the area lb 
is dragged by the pointing device 107 to be included in 
the frame line Lla of the area la, and the size of the 
frame line Lla of the area la is changed. Thus, the 
display is performed such that the frame line LI can 
enclose the entire header in the changed area la, that 
is, the area 1. Thus, the area information, the 
attribute, etc. about the area 1 can be changed. 
[0060] 

As shown in Figure 5, an area can be corrected in 
adding, deleting, changing operations, etc. by a simple 
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operation instruction by a user using the pointing 
device 107 on the original display window W2 . 
[0061] 

The window displayed on the display 105 when the 
attribute added to an area is edited is described below 
with reference to Figure 6. 
[0062] 

Figure 6 is an explanatory view of an example of 
an attribute correction window displayed on the display 
105 shown in Figure 1. 
[0063] 

In Figure 6, W3 is an attribute correction window, 
and is a screen opened by a double-clicking operation 
by the pointing device 107 etc. on an attribute 
correction item registered in the pull-down menu etc. 
to correct the attribute, and is configured by a OK 
button Bl, a cancel button B2, and an attribute 
correction box BOX1 . 
[0064] 

The attribute correction box BOX1 is configured 
by: an item Zl to be selected when the attribute is 
corrected to "text"; an item Z2 to be selected when the 
attribute is corrected to "header"; an item Z3 to be 
selected when the attribute is corrected to "sub- 
header" ; an item Z4 to be selected when the attribute 
is corrected to "page"; an item Z5 to be selected when 
the attribute is corrected to "image"; and an item Z6 
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to be selected when the attribute is corrected to 

"noise" . 

[0065] 

In the attribute correction window W3 , the 
pointing device 107 is operated to select the items Zl 
to Z6 in the attribute correction box BOX1, and the 
attribute can be corrected by clicking the OK button Bl. 
[0066] 

For example, when the attribute of the area la 
shown in Figure 5 is "text", the area la is selected, 
and a correct attribute is selected in the attribute 
correction window W3, thereby the correction can be 
performed. The attribute correction window W3 can be 
displayed near the area whose attribute name is 
displayed, or the color of the area for each attribute 
is determined and displayed so that the attribute of an 
area can be easily checked. 
[0067] 

Thus, when the attribute of the area automatically 
added is different from the actual attribute, it can be 
corrected by the user selection using the pointing 
device 107 etc. in the attribute correction window W3 . 
[0068] 

A window displayed on the display 105 when 
character information added to an area is edited is 
described below with reference to Figure 7. 
[0069] 
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Figure 7 is an explanatory view of an example of a 
character information window displayed on the display 
105 shown in Figure 1 . 
[0070] 

In Figure 7, W4 is a character information window, 
and is a screen opened by a double-clicking operation 
by the pointing device 107, etc. on a character 
information correction item registered in the pull -down 
menu, etc. to correct character information, and is 
configured by a termination button B3 , and a character 
information correction box B0X2 , and character 
information MJ is displayed in the character 
information correction box BOX2 . The portion of "C" in 
the character information MJ is displayed. The 
correction of the character information can be 
terminated by clicking the termination button B3 . 
[0071] 

In Figure 7, the character information about the 
area 1 shown in Figure 5 is generated by the character 
recognizing function of a computer, and corresponds to 
the case in which the "Relating to Speech Synthesis 
Technology" is mistaken for "Relating to Speech 
Cynthesis Technology" 
[0072] 

When the above-mentioned mistake occurs, the 
character information can be corrected by rewriting the 
character information in the character information 
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correction box B0X2 by operating the keyboard 106 or 
the pointing device 107 in the character information 
window W4 when a mistake occurs . 
[0073] 

For example, when the area 1 includes "... Cyn ..." as 
shown in Figure 5, the area 1 is selected, the 
character information window W4 is displayed, and the 

"C" is corrected to "S" . 

[0074] 

Thus, by operating the pointing device 107, etc. 
in the character information window W4 , a user can 
directly input corrected or changed data when an 
automatically recognized character information in an 
area is different from actual character information. 
[0075] 

The characteristic configuration of the present 
embodiment is described below with reference to Figures 
1, 5, 6, 7, etc. 
[0076] 

With the above-mentioned configuration including: 
first display control means for displaying the 
rectangular area extracted by the extraction means and 
the character information recognized by the recognition 
means on a display unit (display 105) ; instruction 
means (instruction by the keyboard 106 and the pointing 
device 107 in the original display window W2, attribute 
correction window W3 , and character information window 
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W4) for issuing a correct instruction for the 
rectangular area or the character information displayed 
on the display unit; and edition means (CPU 101 for 
processing data based on the flowchart shown in Figure 
8 as described later) for correcting the rectangular 
area extracted by the extraction means or the character 
information recognized by the recognition means in 
response to the correct instruction from the 
instruction means, an operator can correct, delete, etc. 
a rectangular area, attribute data, and character 
information in a simple operation although there is a 
fault in an extracted rectangular area, its attribute 
data, and character information. 
[0077] 

Another embodiment relating to storing area 
information is described below with reference to the 
flowchart shown in Figure 8. 
[0078] 

Figure 8 is a flowchart of an example of the third 
data processing procedure in the data processing 
apparatus according to the present invention. (1) to 

(8) indicate the respective steps. 

[0079] 

As in the first embodiment, an image of an 
original is read using the scanner 108 (1) , the area of 
the read original is extracted as described above (2) , 
an attribute is automatically added to the extracted 
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area (3) , and character information is added (4) . At 
this time, the extracted area, attribute, and character 
information are displayed on the display 10 5, and the 
information can be checked. 
[0080] 

Next, the extracted area is edited in the original 
display window W2 shown in Figure 5 (5) . Next, the 
attribute of each area is corrected in the attribute 
correction window W3 (6) . 
[0081] 

Next, character information is edited in the 
character information window W4 shown in Figure 7 (7) , 
the original is stored in the external storage device 
104 (8) in the combination of the area, attribute, and 
character information edited and corrected in steps (5) 
to (7), thereby terminating the process. 
[0082] 

The characteristic configuration of the present 
embodiment is described below with reference to Figure 
8, etc. 
[0083] 

With the above-mentioned configuration including: 
a first display step (not shown in the attached 
drawings) of displaying the rectangular area extracted 
in the extracting step and the character information 
recognized in the recognizing step on a display unit; 
an instructing step (not shown in the attached 
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drawings) of issuing a correct instruction for the 
rectangular area or the character information displayed 
on the display unit; and an editing step (steps (5) to 
(7) ) of correcting the rectangular area extracted in 
the extracting step or the character information 
recognized in the recognizing step in response to the 
correct instruction in the instructing step, an 
operator can correct, delete, etc. a rectangular area, 
attribute data, and character information in a simple 
operation although there is a fault in an extracted 
rectangular area, its attribute data, and character 
information. 
[0084] 

As described above, an area relating to defective 
area extraction and defective character recognition, 
the attribute of the area, and the character in the 
area can be corrected, changed, and deleted to the 
user-desired contents by editing and correcting the 
area information, attribute information, and character 
information according to the present embodiment. 
[0085] 

In the present embodiment, in steps (1) to (3) 
shown in Figure 8, the editing and correcting 
operations are performed after generating area 
information in advance, but all or a part of the area 
information can be manually generated, and the order of 
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the steps (5) to (7) shown in Figure 8 is not limited 
to the order indicated in the present embodiment . 
[0086] 

[Third Embodiment] 

In the above-mentioned second embodiment, an 
automatically determined area, attribute, and character 
information are corrected as necessary, and then stored 
in the external storage device 104, but it is first 
checked whether or not the area of each of a plurality 
of originals stored in the external storage device 104 
has the same attribute as the specified attribute, and 
then plural pieces of character information of the area 
can be sequentially read. The embodiment is described 
below. 

[0087] 

The data processing apparatus according to the 
present embodiment has the same configuration as the 
first embodiment shown in Figure 1. 
[0088] 

The retrieval windows displayed on the display 105 
when a plurality of originals stored in the external 
storage device 104 and the graphic user interface on 
the screen are described below with reference to Figure 
9. 

[0089] 

Figure 9 is an explanatory view of an example of a 
retrieval setting window displayed on the display 105 
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shown in Figure 1. The same components as those shown 
in Figure 6 are assigned the same reference numerals. 
[0090] 

In Figure 9, W5 is a retrieval setting window 
opened when an instruction to execute retrieval is 
issued by the keyboard 106 or the pointing device 107, 
and is configured by the attribute specification 
portion B0X3 and the original specification portion 
B0X4 . The attribute specification portion BOX3 
displays the attribute setting items Zl to Z6 . The 
original specification portion BOX4 displays the 
originals 1 to 5 stored in the external storage device 
104, etc. using the icons Fl to F5, and corresponds to 
the original specified with the inverse icons F2 , F3, 
and F5 to be retrieved. 
[0091] 

In the retrieval setting window W5 configured as 
described above, an attribute to be retrieved can be 
set by selecting the attribute setting items Zl to Z6 
in the attribute specification portion B0X3 by 
operating the keyboard 106 or the pointing device 107, 
and an original to be retrieved can be selected by 
selecting the icons Fl to F5 in the original 
specification portion BOX4 . B2 is a cancel button, and 
a retrieving process can be suspended by pressing the 
cancel button B2 . Bl is an OK button, and the 
retrieval is started when the OK button Bl is pressed. 
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[0092] 

The original specification portion BOX4 is not 
limited to the portion according to the present 
embodiment, but can be configured to display a list of 
names, display a reduced image on the leading page, and 
to use a part of the character information in the 
original to identify the original. 
[0093] 

Thus, an attribute and original to be retrieved 
can be easily set by operating the pointing device 107 
etc. in the retrieval setting window W5 . 
[0094] 

The characteristic configuration of the present 
embodiment is described below with reference to Figures 
1, 9, etc. 
[0095] 

With the above-mentioned configuration including: 
output means (speech synthesis unit 109 and speaker 
110) for voice -output ting character information,- second 
display control means (CPU 101 for displaying the 
retrieval setting window W5) for displaying on the 
display unit a list of original images stored in the 
memory resources and a list of attribute items to be 
retrieved; second specification means (keyboard 106 and 
pointing device 107) for specifying a desired original 
image and attribute item from the original images and 
attribute items displayed on the display unit; second 
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determination means {CPU 101 for determining based on 
the flowchart shown in Figure 10 as described later) 
for determining whether or not an area based on the 
attribute specified by the second specification means 
is selected from the memory resources; and second 
control means (CPU 101 for controlling the speech 
synthesis unit 109) of controlling voice-reading by the 
output means based on a determination result by the 
second determination means, a registered image can be 
listed and displayed, and the contents of the 
registered image can be sequentially and efficiently 
retrieved by voice in a less operation. 
[0096] 

The fourth data processing procedure is described 
below with reference to Figure 10. 
[0097] 

Figure 10 is a flowchart of an example of the 
fourth data processing procedure for use with the data 
processing apparatus according to the present invention. 
(1) to (7) indicate the respective steps. 
[0098] 

First, the attribute to be retrieved is specified 
in the attribute specification portion B0X3 of the 
attribute correction window W3 (1) , the original to be 
retrieved is specified in the original specification 
portion B0X4 (2) , and it is determined whether or not 
all of the specified originals, for example, the icons 
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F2, F3 , and F5 have all been retrieved (3) . If it is 
determined that all originals have been retrieved, then 
the process terminates. 
[0099] 

On the other hand, if it is determined that all 
originals have not been retrieved, then control is 
passed to step (4) . The steps (4) to (6) are similar 
to those in the first embodiment, and if there is an 
area of a specified attribute, the character 
information is read and output through the speaker 110. 
[0100] 

Then, it is determined whether or not an 
instruction from an operator to suspend the process has 
been detected, that is, whether or not the cancel 
button B2 shown in Figure 9 has been pressed (7) . If 
it is determined that the button has not been pressed, 
control is returned to step (3) . If it is determined 
that the button has been pressed, then the process 
terminates . 
[0101] 

As described above, an operation of reading 
unnecessary original information can be suppressed by- 
setting in details the attributes and documents to be 
retrieved and suspending the retrieving process 
according to the present embodiment. 
[0102] 
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In addition, according to the present embodiment, 
only an attribute and an original can be specified as a 
retrieval condition. However, character information 
can be added to the retrieval condition to specify the 
retrieval condition such that an area of a specified 
attribute and including a specified character string in 
the character information, or an area of a specified 
attribute or having character information including a 
specified character string can be retrieved. 
[0103] 

Otherwise, retrieved original name can be read, or 
an original having no selected area can be notified by 
voice to inform that the selected area does not exist. 
[0104] 

Furthermore, in the present embodiment, the 
suspension detection timing is the point where the 
process of the first detected original is completed, 
but it is not limited to this timing. 
[0105] 

The characteristic configuration of the present 
embodiment is described below with reference to Figure 
10, etc. 
[0106] 

With the above-mentioned configuration including: 
a second display step (not shown in the attached 
drawings) of displaying on the display unit a list of 
original images stored in the storing step and a list 
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of attribute items to be retrieved; a second specifying 
step (steps (1) and (2) shown in Figure 10) of 
specifying a desired original image and attribute item 
from the original images and attribute items displayed 
on the display unit; a second determining step (step 

(5) shown in Figure 10) of determining whether or not 
an area based on the attribute specified in the second 
specifying step is selected from the memory resources ; 
and an output step (step (6) shown in Figure 10) of 
voice-outputting character information based on a 
determination result in the second determining step, a 
registered image can be listed and displayed, and the 
contents of the registered image can be sequentially 
and efficiently retrieved by voice in a less operation. 

[0107] 

The configuration of the data processing program 
that can be read by the data processing apparatus 
according to the present invention is described below 
with reference to the memory map shown in Figure 11. 
[0108] 

Figure 11 is an explanatory view of a memory map 
of the storage medium storing various data processing 
programs that can be read by the data processing 
apparatus according to the present invention. 
[0109] 

Although not shown in the attached drawings, the 
information for management of a program graphic stored 
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in the storage medium, for example, version information, 
an author, etc. can be stored, and the information 
depending on the program reading OS, etc., for example, 
an icon identifying and displaying a program can be 
stored . 
[0110] 

Furthermore, data depending on various programs is 
also managed by the directory. In addition, when a 
program for installing various programs in a computer, 
and an installing program are compressed, a 
decompressing program etc. can be stored. 
[0111] 

The functions shown in Figures 3, 4, 8, and 10 
according to the present embodiment can be performed by 
a host computer by a program installed externally. In 
this case, the present invention can be applied when an 
information group including a program is supplied to an 
output device from a storage medium such as CD-ROM, 
flash memory, an FD, etc., or from an external storage 
medium over a network. 
[0112] 

As described above, it is obvious that the purpose 
of the present invention can be attained by supplying a 
storage medium storing a program code of software for 
realizing the functions of the above-mentioned 
embodiments to a system or a device, and the computer 
(or the CPU or the MPU) of the system or the device 
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reading and executing the program code stored in the 
storage medium. 
[0113] 

In this case, the program code read from the 
storage medium realizes the new function of the present 
invention, and the storage medium storing the program 
code configured the present invention. 
[0114] 

A storage medium for supplying a program code can 
be, for example, a floppy disk, a hard disk, an optical 
disk, a magneto optical disk, CD-ROM, CD-R, a magnetic 
tape, a nonvolatile memory card, ROM, EEPROM, etc. 
[0115] 

It is obvious that the functions of the above- 
mentioned embodiments are realized not only by 
executing a program code read by a computer, but also 
by the process performed by the OS (operating system) 
operating on the computer and performing all or a part 
of the actual process according to the instruction of 
the program code . 
[0116] 

Furthermore, it is obvious that the functions of 
the above-mentioned embodiments are realized by the 
process performed by a program code read from a storage 
medium after the program code is written to the memory 
in the feature expansion board inserted into the 
computer and the feature expansion unit connected to 
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the computer, and the program code performing all or a 
part of the actual process by the CPU, etc. provided 
with the feature expansion board and the feature 
expansion unit. 
[0117] 

As described above, the first invention includes: 
read means for reading a document image on an original 
and outputting image data; extraction means for 
analyzing the image data read by the read means, and 
extracting a rectangular area of an optional size from 
the original image; addition means for adding attribute 
data different based on a form of each rectangular area 
extracted by the extraction means; recognition means 
for analyzing image data in each rectangular area to 
which attribute data is added by the addition means, 
and recognizing character information; and storage 
means for adding the character information recognized 
by the recognition means and the attribute data to each 
area, and storing resultant data with the image data in 
memory resources. Therefore, a character information 
area that can be retrieved can be segmented using voice 
as a key from the original image to be registered and 
automatically stored with the registered information, 
the process of user inputting retrieval information 
about the registered image can be reduced, and an 
effective registered information appropriate for 
associating the registered image can be simply input. 
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[0118] 

The second invention includes : output means for 
voice-outputting character information; first 
specification means for specifying an attribute of an 
area to be retrieved for image data stored in the 
memory resources; first determination means for 
determining whether or not an area based on the 
attribute specified by the first specification means is 
selected from the memory resources; and first control 
means for controlling voice-reading by the output means 
based on a determination result by the first 
determination means. Therefore, the contents of the 
registered image can be efficiently checked by voice in 
a simple operation of an operator specifying an area to 
which an attribute is added without the necessity to 
take a long processing time to display an image of the 
entire image data. 
[0119] 

The third invention includes: first display 
control means for displaying the rectangular area 
extracted by the extraction means and the character 
information recognized by the recognition means on a 
display unit; instruction means for issuing a correct 
instruction for the rectangular area or the character 
information displayed on the display unit; and edition 
means for correcting the rectangular area extracted by 
the extraction means or the character information 
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recognized by the recognition means in response to the 
correct instruction from the instruction means. 
Therefore, a rectangular area, attribute data, and 
character information can be corrected, deleted, etc. 
in a simple operation although there is a fault in an 
extracted rectangular area, its attribute data, and 
character information. 
[0120] 

The fourth invention includes: output means for 
voice-outputting character information; second display 
control means for displaying on the display unit a list 
of original images stored in the memory resources and a 
list of attribute items to be retrieved; second 
specification means for specifying a desired original 
image and attribute item from the original images and 
attribute items displayed on the display unit; second 
determination means for determining whether or not an 
area based on the attribute specified by the second 
specification means is selected from the memory 
resources; and second control means of controlling 
voice -reading by the output means based on a 
determination result by the second determination means. 
Therefore, a registered image can be listed and 
displayed, and the contents of the registered image can 
be sequentially and efficiently retrieved by voice in a 
less operation. 
[0121] 
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The fifth and sixth inventions include: a reading 
step of reading a document image on an original and 
outputting image data; an extracting step of analyzing 
the image data read in the reading step, and extracting 
a rectangular area of an optional size from the 
original image; an adding step of adding attribute data 
different based on a form of each rectangular area 
extracted in the extracting step; a recognizing step of 
analyzing image data in each rectangular area to which 
attribute data is added in the adding step, and 
recognizing character information; and a storing step 
of adding the character information recognized in the 
recognizing step and the attribute data to each area, 
and storing resultant data with the image data in 
memory resources. Therefore, a character information 
area that can be retrieved is segmented using voice as 
a key from an original image to be registered and 
automatically stored with the registered information, a 
user input process of the retrieval information about 
the registered image can be reduced, thereby simply 
inputting an effective retrieval information 
appropriate for associating the registered image. 
[0122] 

The seventh and eighth inventions include: a first 
specifying step of specifying an attribute of an area 
to be retrieved for the image data stored in the 
storing step; a first determining step of determining 



- 53 - 



Whole Englsih translation of JPA11-085457 



whether or not an area based on the attribute specified 
in the first specifying step is selected from the 
memory resources; and an outputting step of voice- 
outputting character information based on the 
determination result in the first determining step. 
Therefore, the contents of the registered image can be 
efficiently checked by voice in a simple operation of 
an operator specifying an area to which an attribute is 
added without the necessity to take a long processing 
time to display an image of the entire image data. 
[0123] 

The ninth and tenth inventions include: a first 
display step of displaying the rectangular area 
extracted in the extracting step and the character 
information recognized in the recognizing step on a 
display unit; an instructing step of issuing a correct 
instruction for the rectangular area or the character 
information displayed on the display unit; and an 
editing step of correcting the rectangular area 
extracted in the extracting step or the character 
information recognized in the recognizing step in 
response to the correct instruction in the instructing 
step. Therefore, a rectangular area, attribute data, 
and character information can be corrected, deleted, 
etc. by an operator in a simple operation although 
there is a fault in an extracted rectangular area, its 
attribute data, and character information. 



- 54 - 



Whole Englsih translation of JPA11-085457 



[0124] 

The eleventh and twelfth inventions include: a 
second display step of displaying on the display unit a 
list of original images stored in the storing step and 
a list of attribute items to be retrieved; a second 
specifying step of specifying a desired original image 
and attribute item from the original images and 
attribute items displayed on the display unit; a second 
determining step of determining whether or not an area 
based on the attribute specified in the second 
specifying step is selected from the memory resources ,- 
and an output step of voice-outputting character 
information based on a determination result in the 
second determining step. Therefore, a registered image 
can be listed and displayed, and the contents of the 
registered image can be sequentially and efficiently 
retrieved by voice in a less operation. 
[0125] 

Therefore, the character information added to the 
area of the original image is voice-read, and an 
operator is allowed to voice-confirm the contents of 
the original image in a short time only by a simple 
operation of specifying an operator-specific attribute 
and an original image without the necessity to take a 
long time to display the image of the entire original 
image . 

[Brief Description of the drawings] 
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[Figure 1] 

Figure 1 is a block diagram of the configuration 
of the data processing apparatus according to the first 
embodiment of the present invention; . 
[Figure 2] 

Figure 2 shows an example of the first original 
display window displayed on the display shown in Figure 
1; 

[Figure 3] 

Figure 3 is a flowchart of an example of the first 
data processing procedure in the data processing 
apparatus according to the present invention; 
[Figure 4] 

Figure 4 is a flowchart of an example of the 
second data processing procedure in the data processing 
apparatus according to the present invention; 
[Figure 5] 

Figure 5 is an explanatory view of the second 
original display window displayed on the display shown 
in Figure 1 ; 
[Figure 6] 

Figure 6 is an explanatory view of an example of 
an attribute correction window displayed on the display 
shown in Figure 1; 
[Figure 7] 
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Figure 7 is an explanatory view of an example of a 
character information window displayed on the display 
shown in Figure 1; 
[Figure 8] 

Figure 8 is a flowchart of an example of the third 
data processing procedure in the data processing 
apparatus according to the present invention; 
[Figure 9] 

Figure 9 is an explanatory view of an example of a 
retrieval setting window displayed on the display shown 
in Figure 1 ; 
[Figure 10] 

Figure 10 is a flowchart of an example of the 
fourth data processing procedure in the data processing 
apparatus according to the present invention; and 
[Figure 11] 

Figure 11 is an explanatory view of a memory map 
of a storage medium storing various data processing 
programs readable in the data processing apparatus 
according to the present invention. 
[Description of Reference Numerals] 

101 CPU 

102 ROM 

103 RAM 

104 external storage device 

105 display 

10 6 keyboard 
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107 pointing device 

108 scanner 

109 speech synthesis unit 

110 speaker 
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Figure 1 

104 EXTERNAL STORAGE DEVICE 

105 DISPLAY 

106 KEYBOARD 

107 POINTING DEVICE 

108 SCANNER 

109 SPEECH SYNTHESIS UNIT 
Figure 2 

1 RELATING TO SPEECH SYNTHESIS TECHNOLOGY 

2 SPEECH SYNTHESIS TECHNOLOGY REFERS TO TECHNOLOGY 
OF CONVERTING SENTENCE INTO AUDIO SIGNAL. THIS 
SENTENCE IS FOR EXPLANATION OF THE PRESENT INVENTION ... 

4 SAMPLE. TEXT IN THIS EXAMPLE. 

5 SPEECH SYNTHESIS MEANS 

6 BEFORE EXPLANATION OF SPEECH SYNTHESIS, INPUTTING 
IMAGE IS DESCRIBED 

Figure 3 
#1 START 

1 READ IMAGE 

2 EXTRACT AREA 

3 ADD ATTRIBUTE TO AREA 

4 ADD CHARACTER INFORMATION TO AREA OF ATTRIBUTE 
INCLUDING CHARACTER 

5 STORE AREA INFORMATION 
#2 END 
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Figure 4 
#1 START 

1 RETRIEVE ATTRIBUTE 

2 AREA SELECTED? 

3 READ CHARACTER INFORMATION ABOUT SELECTED AREA 
#2 END 

Figure 5 

1 RELATING TO SPEECH SYNTHESIS TECHNOLOGY 

2 SPEECH SYNTHESIS TECHNOLOGY REFERS TO TECHNOLOGY 
OF CONVERTING SENTENCE INTO AUDIO SIGNAL. THIS 
SENTENCE IS FOR EXPLANATION OF THE PRESENT INVENTION ... 

4 SAMPLE. TEXT IN THIS EXAMPLE. 

5 SPEECH SYNTHESIS MEANS 

6 BEFORE EXPLANATION OF SPEECH SYNTHESIS, INPUTTING 
IMAGE IS DESCRIBED 

Figure 6 

21 TEXT 

22 HEADER 

23 SUB -HEADER 

24 PAGE 

25 IMAGE 

26 NOISE 
B2 CANCEL 
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Figure 7 

#1 RELATING TO SPEECH CYNTHESIS TECHNOLOGY 
#2 TERMINATE 

Figure 8 
#1 START 

1 READ IMAGE 

2 EXTRACT AREA 

3 ADD ATTRIBUTE TO AREA 

4 ADD CHARACTER INFORMATION TO AREA OF ATTRIBUTE 
INCLUDING CHARACTER 

5 EDIT AREA 

6 CORRECT ATTRIBUTE 

7 EDIT CHARACTER INFORMATION 

8 STORE AREA INFORMATION 
#2 END 

Figure 9 

2 1 TEXT 

2 2 HEADER 

2 3 SUB -HEADER 

24 PAGE 

25 IMAGE 

26 NOISE 

PI ORIGINAL 1 
P2 ORIGINAL 2 
P3 ORIGINAL 3 
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P3 ORIGINAL 4 
P5 ORIGINAL 5 
B2 CANCEL 

Figure 10 

#1 START 

1 SPECIFY ATTRIBUTE 

2 SPECIFY ORIGINAL TO BE RETRIEVED 

3 ALL ORIGINALS RETRIEVED? 

4 SPECIFY ORIGINAL TO BE RETRIEVED 

5 AREA SELECTED? 

6 READ CHARACTER INFORMATION IN SELECTED AREA 

7 RETRIEVAL SUSPENDED? 
#2 END 

Figure 11 

#1 STORAGE MEDIUM SUCH AS FD/CD-ROM 

#2 DIRECTORY INFORMATION 

#3 FIRST DATA PROCESSING PROGRAM 

PROGRAM CODE GROUP CORRESPONDING TO STEPS IN 
FLOWCHART SHOWN IN Figure 3 
#4 SECOND DATA PROCESSING PROGRAM 

PROGRAM CODE GROUP CORRESPONDING TO STEPS IN 
FLOWCHART SHOWN IN Figure 4 
#5 THIRD DATA PROCESSING PROGRAM 

PROGRAM CODE GROUP CORRESPONDING TO STEPS IN 
FLOWCHART SHOWN IN Figure 8 
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#6 FOURTH DATA PROCESSING PROGRAM 

PROGRAM CODE GROUP CORRESPONDING TO STEPS IN 
FLOWCHART SHOWN IN Figure 10 
#7 MEMORY MAP OF STORAGE MEDIUM 
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